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Abstract. Tropical polyhedra have been recently used to represent disjunctive invariants in static 
analysis. To handle larger instances, tropical analogues of classical linear programming results 
need to be developed. This motivation leads us to study the tropical analogue of the classical 
linear-fractional programming problem. We construct an associated parametric mean payoff game 
problem, and show that the optimality of a given point, or the unboundedness of the problem, can 
be certified by exhibiting a strategy for one of the players having certain infinitesimal properties 
(involving the value of the game and its derivative) that we characterize combinatorially. We use this 
idea to design a Newton-like algorithm to solve tropical linear-fractional programming problems, 
by reduction to a sequence of auxiliary mean payoff game problems. 



1. Introduction 

1.1. Motivation from static analysis. Tropical algebra is the structure in which the set of real 
numbers, completed with — oo, is equipped with the "additive" law "a-|-6" := aV6 = max(a, 6) and 
the "multiplicative" law "a6" := a + b. The max-plus or tropical analogues of convex sets have been 
studied by a number of authors |Zim77l [CG791 [dP97l ILMSOll |CGQ04i [PSOil iBHOil [J^iOS] , under 



various names (idempotent spaces, semimodules, B-convexity, extremal convexity), with different 
degrees of generality, and various motivations. 

In the recent work [AGGOSj . Allamigeon, Gaubert and Goubault have used tropical polyhedra 
to compute disjunctive invariants in static analysis. A general (affine) tropical polyhedron can be 
represented as 

(1) P := {x G (R U {-oo})" I ( V {aij + xj)) V q < ( V {hj + xj)) V di, Vi G [m]}. 

j€[n] j€[n] 

Here, we use the notation [n] := {l,...,n}, and the parameters a^j, bij, Ci and di are given, 
with values in M U {— cxd}. The analogy with classical polyhedra becomes clearer with the tropical 
notation, which allows us to write the constraints as "Aj; + c < Bx + d" , to be compared with 
classical systems of linear inequalities. Ax < d (in the tropical setting, we need to consider affine 
functions on both sides of the inequality due to the absence of opposite law for addition). The 
previous representation of P is the analogue of the external representation of polyhedra, as the 
intersection of half-spaces. As in the classical case, tropical polyhedra have a dual (internal) 
representation, which involves extreme points and extreme rays. The tropical analogue of Motzkin 
double description method allows one to pass from one representation to the other |AGG10b] . 

Disjunctive invariants arise naturally when analyzing sorting algorithms or in the verification of 
string manipulation programs. The well known memcpy function of C is discussed in [AGGOSj as 
a simple illustration: when copying the first n characters of a string buffer src to a string buffer 



Key words and phrases. Mean payoff games, tropical algebra, linear programming, linear-fractional programming, 
Newton iterations, Lagrange multipliers, optimal strategies. 

The first author was partially supported by the Arpege programme of the French National Agency of Research 
(ANR), project "ASOPT", number ANR-08-SEGI-005 and by the Digiteo project DIM08 "PASO" number 3389. 
The third author was supported by the EPSRC grant RRAH12809 and the RFBR-CNRF grant 11-01-93106. This 
work was initiated when this author was with the School of Mathematics at the University of Birmingham. 

1 



dst, the length len_dst of the latter buffer may differ from the length leii_src of the former, for 
if n is smaller than len_src, the null terminal character of the buffer src is not copied. However, 
the relation min(len_src, n) = min(len_dst, n) is valid. This can be expressed geometrically by 
saying that the vector (— len_src, — len_dst) belongs to a tropical polyhedron. Several examples 
of programs of a disjunctive nature, which are analyzed by means of tropical polyhedra, can be 
found in |AGG081 IA1109j . in which the tropical analogue of the classical polyhedra-based abstract 
interpretation method of |CH78j has been developed. 

The comparative interest of tropical polyhedra is illustrated in Figure [H which gives a sim- 
ple fragment of code in which the tropical invariant is tighter. Note that there is still an over- 
approximation in the tropical case, because the transfer function considered here is discontinuous 
(tropical polyhedra share with classical polyhedra the property of being connected, and therefore 
cannot represent exactly such discontinuities). Such tropical invariants can be obtained auto- 
matically via the methods of |AGG08| IA1109] . which rely on the tropical analogue of the double 
description algorithm [AGGlOb] . allowing one to obtain the vertices of a tropical polyhedron from 
a family of defining inequalities, and vice versa. 

As in the case of classical polyhedra, the scalability of the approach is inherently limited by the 
exponential blow up of the size of representations of polyhedra, since the number of vertices or of 
defining inequalities can be exponential in the size of the input data [AGKllat lAGKllb] . 

The complexity of earlier polyhedral approaches led Sankaranarayanan, Colon, Sipma and Manna 
to introduce the method of templates |SSM051 ISCSM06"] . In a nutshell, a template consists of a 
finite set T = {gi , ■ ■ ■ , gm} of linear forms on M". The latter define a parametric family of polyhedra 



with precisely m degrees of freedom ai, . . . , am € M U {-|-oo}. The classical domains of boxes or 
the domain of zones (potential constraints) |Min04j are recovered by incorporating in the template 
the linear forms g{x) = zizXi or g{x) = Xi — Xj, respectively. Fixing the template, or changing it 
dynamically while keeping m bounded, avoids the exponential blow up. 

The method of |SCSM06] relies critically on linear programming, which allows one to evaluate 
quickly the fixed point functional of abstract interpretation. However, the precision of the invariants 
remains limited by the linear nature of templates, and it is natural to ask whether the machinery 
of templates carries over to the non-linear case. 

The formalism of templates has been extended to the non-linear case by Adje, Gaubert and 
Goubault [AGGlOa] . who considered specially quadratic templates, the linear programming meth- 
ods of |SCSM06] being replaced by semidefinite programming, thanks to Shor's relaxation. More 
generally, every tractable subclass of optimization problems yields a tractable template. 

In order to compute disjunctive invariants, Allamigeon, Gaubert and Goubault suggested to 
develop a generalization of the template method to the case of tropical polyhedra. As a preliminary 
step, the relevant results of linear programming must be tropicalized: this is the object of the present 
paper. 

In particular, comparing the expressions of P and Pa, we see that the classical linear forms must 
now be replaced by the differences of tropical affine forms 



where pj, r, qj and s are given parameters with values in M U {— oo}. 

1.2. The problem. In this paper, we study the following tropical linear-fractional programming 
problem: 



Pa = {xe M" I gk{x) <ak , ke [m]} 



(2) 




(3) 



minimize g{x) 
subject to: x & P 



2 




if X > y then 

z : = x ; 
else 

z: = y + l; 




X < z 

y < max(j;, z — 1) 
z < max(x, y + 1) 



X < z 

y < z 



Figure 1. The tropical polyhedral abstraction of a transfer function, follow- 
ing [AGGOSj . versus the classical polyhedral abstraction. The optimal invariant 
is represented by the union of two half-lines. The tropical over-approximation of 
this behavior (union of the triangle in dark gray and of the half-lines, left) is more 
accurate than the classical polyhedral one (cone in light gray, right). 



where P is given by ([T]) and g is given by ([2]) . This is the tropical analogue of the classical linear- 
fractional programming problem 

minimize (px + r)/{qx + s) 

subject to: Ax + c<Bx + d,x>0,xeR"' 

where p, q are nonnegative vectors, r, s are nonnegative scalars, and A, B, c, d are matrices and 
vectors. The constraint "x > 0" is implicit in ([3]), since any number is "nonnegative" (i.e. > — oo) 
in the tropical world. 

Problem ([3]) includes as special cases 

(4) 9{x) = y (pj + Xj) and g{x) = - V (qj + xj) 

(take qj = — oo, r = — oo and s = 0, or pj = — oo, s = — oo and r = 0). According to the terminology 
of |B AOS] ■ the latter may be thought of as the tropical analogues of the linear programming problem. 
However, optimizing the more general fractional objective function ([2]) appears to be needed in a 
number of basic applications. In particular, in static analysis, we need typically to compute the 
tightest inequality of the form Xi < K -\- xj satisfied by the elements of P. This fits in the general 
form ([2]), but not in the special cases dH. 

1.3. Contribution. A basic question in linear programming is to certify the optimality of a given 
point. This is classically done by exhibiting a feasible solution of the dual problem (i.e. a vector of 
Lagrange multipliers) with the same value. There is no such a simple result in the tropical setting, 
because as remarked in |GK09j . there are (tropically linear) inequalities which can be logically 
deduced from some finite system of (tropically linear) inequalities but which cannot be obtained 
by taking (tropical) linear combinations of the inequalities of the system. In other words, the 
usual statement of Farkas lemma is not valid in the tropical setting. However, recently Allamigeon, 
Gaubert and Katz [AGKllb] established a tropical analogue of Farkas lemma, building on [A GG09j . 
in which Lagrange multipliers are replaced by strategies of an associated mean payoff game. We 
use the same idea here, and show in Subsection 13.31 (Theorem [12] below) that the optimality of a 
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solution can be (concisely) certified by exhibiting a strategy of a game, having certain combinatorial 
properties. Similarly, whether the value of the tropical linear-fractional programming problem is 
unbounded can also be certified in terms of strategies (Theorem I13p . 

The second ingredient is to think of the tropical linear-fractional programming problem as a 
parametric mean payoff game problem. Then, the tropical linear-fractional programming problem 
reduces to the computation of the minimal parameter for which the value of the game is nonnegative. 
As a function of the parameter, this value is piecewise-linear and 1-Lipschitz, see Subsection 13.21 
for a more detailed description. 

The main contribution of this paper is a Newton-like method, where at each iteration we select 
a strategy playing the role of derivative (whose existence is implied by the fact that the current 
feasible point is not optimal). This defines a one player parametric game problem, and we show 
that the smallest value of the parameter making the value zero can be computed in polynomial 
time for this subgame, by means of shortest path algorithms as described in Subsection 13.51 The 
master algorithm (Algorithm [2]) requires solving at each iteration an auxiliary mean payoff game, 
see Subsections 13.61 and 13.71 Mean payoff games can be solved either by value iteration, which is 
pseudo-polynomial, or by policy iteration, for which exponential time instances have been recently 
constructed in |Fri09j . although the algorithm is fast on typical examples. The number of New- 
ton type iterations of the Newton-like algorithm has a trivial exponential bound (the number of 
strategies), and we show that the algorithm is pseudo-polynomial, see Theorem 1191 Although this 
algorithm seems to behave well on typical examples, see in particular Subsection 14.11 some further 
work would be needed to assess its worst case complexity (its behavior is likely to be similar to the 
one of policy iteration, see Subsection 14.31 for a preliminary account of numerical experiments). 

1.4. Related work. Butkovic and Aminu |BA08] studied the special cases ([4]), see also [ButlO^ 
Chapter 10]. At each iteration, they solve a feasibility problem (whether a tropical polyhedron is 
non-empty) , which is equivalent to checking whether a mean payoff game is winning for one of the 
players. However, their algorithm does not involve a Newton-like iteration, but rather a dichotomy 
argument. In |BA08| the number of calls to a mean payoff oracle, whose implementation relies on 
the alternating method of |CGB03j . depends on the size of the integers in the input, whereas the 
number of calls in the present algorithm can be bounded independently of these, just in terms of 
strategies. 

A different approach to tropical linear programming was developed previously in the works of U. 
Zimmermann |Zim81j and K. Zimmermann [ZimOSj . This approach, which is based on residuation 
theory, and works over more general idempotent semirings, identifies important special cases in 
which the solution can be obtained explicitly (and often, in linear time). However, it cannot 
be applied to our more general formulation, in which there is little hope to find similar explicit 
solutions. 

Newton methods for finding the least fixed point of nonlinear functions are also closely related 
to this paper. Such methods were developed in [CGG+051 [GGTZ071 IGSOT] to solve monotone fixed 
point problems arising in abstract interpretation. Esparza et al. |EGKS08] develop such methods 
for monotone systems of min-max-polynomial equations. They seek for the least fixed point of a 
function whose components are max-polynomials or min-polynomials, showing that their Newton 
methods have linear convergence at least. The class of functions considered there is considerably 
more general than the tropical linear forms appearing here, but the fixed point problems considered 
in |EGKS08] appear to be of a different nature. It would be interesting, however, to connect the 
two approaches. 

1.5. Further motivation. Tropical polyhedra have been used in |Kat07j to determine invariants 
of discrete event systems. Systems of constraints equivalent to the ones defining tropical polyhedra 
have also appeared in the analysis of delays in digital circuits, and in the study of scheduling 
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problems with both "and" and "or" constraints |MSS04j . Such systems have been studied by 
Bezem, Nieuwenhuis, and Rodriguez-Carbonell [BNRCOSl IBNRClOj . under the name of the "max- 
atom problem". The latter is motivated by SAT Modulo theory solving, since conjunctions of max- 
atoms determine a remarkable fragment of linear arithmetic. Tropical polyhedra also turn out to 
be interesting mathematical objects in their own rig ht |DS041[Jos05] . A final motivation arises from 
mean payoff games, the complexity of which is a well known open problem: a series of works show 
that a number of problems which can be expressed in terms of tropical polyhedra are polynomial 
time equivalent to mean payoff games prob lems pSSOl IDG06[ IAGG091 IBNRCIOI lAGKllbj . 
The results of the present paper rely on jAGG09l lAGKllb] . 

2. Preliminaries 

In this section, we recall some definitions and results needed to describe the present tropical 
linear-fractional programming algorithm. 

We start by introducing deterministic mean payoff games played on a finite bipartite digraph, 
see Subsection 12.11 We then summarize some elements of the operator approach to such games, 
in including a theorem of [KohSOj . Theorem [2] below, implying that their dynamic programming 
operators / have invariant half-lines (x, v). These invariant half-lines determine the ultimate growth 
of the orbits f^{x)/k, known as the cycle-time vector xif) of f. They also determine a pair of 
optimal strategies, and the winning nodes of the players {{i \ Xiif) ^ 0} aiid {i \ Xi{f) < 0}) in 
the associated game. 

Then, we recall in Subsection 12.21 the correspondence between tropical polyhedra and mean 
payoff games, along the lines of |AGG09j : Theorem [5] shows that i is a winning node (xiif) ^ 0) 
if, and only if, the associated tropical two-sided system of inequalities has a solution x whose ith 
coordinate is finite (xj ^ —oo). We also recall the max-plus and min-plus representations of min- 
max functions, together with the combinatorial characterization, in terms of maximal or minimal 
cycle means, of the cycle time vector for one-player games. This will be used to construct optimality 
and unboundedness certificates in Subsection 13. 3i 

2.1. Mean payoff games and min-max functions. Consider a two-player deterministic game 
where the players, called "Max" and "Min" , make alternate moves of a pawn on a weighted bipartite 
digraph Q. The set of nodes of Q is the disjoint union of the nodes [m] where Max is active, and 
the nodes [n] where Min is active. When the pawn is in node k € [m] of Max, he must choose an 
arc in Q connecting node k with some node I € [n] of Min, and while moving the pawn along this 
arc, he receives the weight 6^/ of the selected arc as payment from Min. When the pawn is in node 
j G [n] of Min, she must choose an arc in G connecting node j with some node i € [m] of Max, 
and pays —aij to Max, where —aij is the weight of the selected arc. We assume that bi^i,ciij € M. 
Moreover, certain moves may be prohibited, meaning that the corresponding arcs are not present 
in Q. Then, we set b^i = —oo and Uij = — oo. Thus, the whole game is equivalently defined by 
two m X n matrices A = (aij) and B = {b^i) with entries in M U {— oo}. We make the following 
assumptions, which assure that both players have at least one move allowed in each node. 

Assumption 1. For all k € [m] there exists / € [n] such that b^i 7^ —00. 

Assumption 2. For all j E [n] there exists i € [m] such that aij 7^ —00. 

A general strategy for a player (Max or Min) is a function that for every finite history of a play 
ending at some node selects a successor of this node (i.e., a move of the player). A positional 
strategy for a player is a function that selects a unique successor of every node independently of the 
history of the play. 

A strategy for player Max will be usually denoted by a and a strategy for player Min by r. 
Thus, a positional strategy for player Max is a function a : [m] 1— ?> [n] such that is finite for all 
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i G [m], and a positional strategy for player Min is a function r: [n] i— ?> [m] such that Or{j)j is finite 
for all j € [n]. 

When player Max reveals his positional strategy a, the play proceeds within the digraph G'^ 
where at each node i of Max all but one arc {i,a{i)) are removed. When player Min reveals her 
positional strategy r, the play proceeds within the digraph Q'^ where at each node j of Min all but 
one arc {j,T{j)) are removed. 

When player Max reveals his positional strategy a and player Min her positional strategy r, 
the play proceeds within the digraph G'^''^ where each node has a unique outgoing arc {i,a{i)) or 
{j,T(j)). Thus, Q'^''^ is a "sunflower" digraph, i.e., such that each node has a unique path to a 
unique cycle. 

The infinite horizon version of this mean payoff game starts at a node j of Miij^ and proceeds 
according to the strategies (not necessarily positional) of the players, who are interested in the 
value of average payment. More precisely, player Min wants to minimize 

k 

^) •= l™sup -ai,j,_, + bi^jj/k , jo = j , 
while player Max wants to maximize 

k 

0-) := liminf (V -ai^j^_^ + bi^jj/k , Jq = j , 

fc— >-oo ^ — ' 

t=l 

where ji € [n], ii G [m], j2 G [n], i2 G [m], ... is the infinite sequence of positions of the pawn 
resulting from the selected strategies r and a of the players. The next theorem shows that this game 
has a value. An analogue of this theorem concerning stochastic games was obtained by |LL69j . 

Theorem 1 ( |EM79PGKK88j ) . For the mean payoff game whose payments are given by the matrices 
A,B(^ (M U {— oo})™"^", where A,B satisfy Assumptions 1 and 2, there exists a vector x G and 
a pair of positional strategies a* and r* such that 

(i) <I>™'g(j, r*, cj) < X'j for all (not necessarily positional) strategies a, 

(ii) <l>™^^(j, r, fj*) > Xj for all (not necessarily positional) strategies t, 
for all nodes j of Min. 

In other words, player Max has a positional strategy a* which secures a mean profit of at least Xj 
whatever is the strategy of player Min, and player Min has a positional strategy r* which secures 
a mean loss of no more than Xj whatever player Max does. 

A finite duration version of the mean payoff game considered above can be also formulated. 
Again, it starts at a certain node j of Min and proceeds according to the strategies of the players 
(not necessarily positional), but stops immediately when a cycle jo G [m] — )• ii G [n] — )• ji G [m] — )• 
■ ■ ■ ^ ik € [n] ^ jk = jo is formed. Then, the outcome of the game is the mean weight per turn 
(so the length of a cycle may be seen as the number of nodes of Max or Min it contains) of that 
cycle: 

k 

(5) ^A,B{j, T, a) := {J2 -Oztjt~i + hjt)/k ■ 

t=i 

The ambition of Max is to maximize ^a^bU, t, o") while Min is seeking to minimize it. 

It was shown in |EM79t Theorem 2] that this finite duration version of the game has the same 
value as the infinite horizon version described above, and that there are positional optimal strategies 

-'^The game can start also at a node i of Max, the requirement to be started by Min is for better consistency with 
min- max functions and two-sided tropical systems, see (0 and p4p . 
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which secure this value for both versions of the game. It follows by standard arguments that Xj is 
determined uniquely by 

(6) Xj = ^A.Bij,T*,a*) = mmmax^A.Bij,T,a) = maxmin <I>yi.B(i, r, cj) , 

where r and a range over the sets of all strategies (not necessarily positional) for players Min and 
Max, respectively. 

The dynamic programming operator / : M" i— )■ M" associated with the infinite horizon mean 
payoff game is defined by: 

(7) fj{x) = A (-akj+ y(bM + xi)) . 

This function, combining min-plus and max-plus linearity (see below in Subsection 12. 2p . is known 
as a min-max function |CTGG99] . Min- max functions are isotone {x < y =>- f{x) < f{y)) and 
additively homogeneous (/(A + x) = \ + f{x)). Hence, they are nonexpansive in the sup-norm. 
Moreover, they are piecewise affine (M"' can be covered by a finite number of polyhedra on which 
/ is affine). We are interested in the following limit {cycle-time vector): 

(8) xif) = lim f\x)/k . 

The jth entry of the vector x{f) can be interpreted as the limit of the mean value of the game per 
turn, as the horizon k tends to infinity, when the starting node is j. The existence of x{f) follows 
from a theorem of Kohlberg. 

Theorem 2 ( |Koh80j ). Let f : M" i— > M" be a nonexpansive and piecewise affine function. Then, 
there exist v € M" and x ^ I^" such that 

f{v + tx) = v + {t + l)x , yt>T , 

where T is a large enough real number. 

The function t v + tx known as an invariant half-line. Using the nonexpansiveness of /, 
one deduces that the limit ([8]) exists, is the same for all x S M" and is equal to the growth rate x 
of any invariant half-line. 

Given fixed positional strategies r and a for players Min and Max, respectively, we can consider 
the dynamic operators corresponding to the partial digraphs Q'^ and Q'^ . These operators are 
max-only and min-only functions: 

fj{x) = -a^y)j + V (6,(j-); + xi) , 

(9) 

'tg[m] 

They are the main subject of tropical linear algebra, see Subsection 12.21 where in particular we 
recall how their cycle-time vectors can be computed. Theorem [10] below relates these cycle-time 
vectors with the cycle time vector of the min-max function d?]) . 

The following result can be derived as a standard corollary of Kohlberg's theorem. Indeed, we 
define a positional strategy r of Min and a positional strategy a of Max by the condition that 
f{v + tx) = f"{v + tx) = f^{v -\- tx) for t large enough, where t v -\- tx '^s an invariant half- line. 
These strategies are easily seen to be optimal for the mean payoff game. 

Theorem 3 (Coro. of [KohSO] ) . For f{x) given by ([7]), the jth coordinate of x{f) is the value of 
the mean payoff game which starts at node j of Min. 

In what follows, we shall use the following form of the value existence result ([6]), which was proved 
in |GG98| as a corollary of the termination of the policy iteration algorithm of |GG98l ICTGG99] , 
see |DG06j for a more recent presentation. Alternatively, it can be quickly derived from [KohSOj 
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(the derivation can be found in |AGG09l Theorem 2.13]). This result has been known as the 
"duahty theorem" in the discrete event systems hterature. 



Theorem 4 (Coro. of [KohSOj . [GGOSQ . Let A,B e (MU {-oo})™^" satisfy Assumptions 1 and 2, 
and let S and T he the sets of all positional strategies for players Max and Min, respectively. Then, 

(10) max xin = Xif) = min xifl ■ 

This characterization of xif) should be compared with ([6]). The latter shows that the infinite 
horizon version of the game with limsup/liminf payoff has a value, whereas (llOp concerns the limit 
of the value of the finite horizon version. Thus, in loose terms, the "limit" and "value" operations 
commute. 



2.2. Tropical linear systems and mean payoff games. Max-only and min-only functions of the 
form Q belong to tropical linear algebra. Max-only functions are linear in the max-plus semiring 
I^max) which is the set M U {— oo} equipped with the operations of "addition" "a -|- 6" := a V 6 and 
"multiplication" "a6" := a + b. For min-only functions, we use the min-plus semiring Mj^i^; i*^* the 
set M U {+00} equipped with the operations of "addition" "a -|- 6" := aAb and the same "additive" 
multiplication. The setting in which both structures are considered simultaneously has been called 
minimax algebra in |CG79j . Then, we need to allow the scalars to belong to the enlarged set 
M := M U {—00} U {+cxd}. Note that in M, {—00) + (+00) = —00 if the max-plus convention is 
considered and (—00) -|- (+C!o) = +00 if the min-plus convention is considered. 

The tropical operations are extended to matrices and vectors in the usual way. In particular, for 
any matrix E = (eij) and any vector x of compatible dimensions: 

(11) ^\Ex)i" = y Bij +Xj (max-plus) , ^\Ex)i" = Aeij + Xj (min-plus) . 

j j 

Max-plus and min-plus linear functions are mutually adjoint, or residuated. Recall that for a max- 
plus linear function from M to M , given by € M™^", the residuated operator E* from M to 
M is defined by 

(12) {Eh)j--= ^{-e^,+y^) , 

with the convention (—00) -|- (+00) = -|-oo. Note that this residuated operator, also known as 
Cuninghame- Green inverse, is given by the multiplication of —E^^ by y with the min-plus operations 
(here E"^ denotes the transposed of E), and that it sends M^g^^ to Mmax whenever E does not have 
columns identically equal to —00. 

In what follows, concatenations such as Ex should be understood as the multiplication of E 
by X with the max-plus operations, and concatenations such as E'^y should be understood as the 
multiplication of —E'^ by y with the min-plus operations (and the corresponding conventions for 
(-CX)) + (+00)). 

The term "residuated" refers to the property 

(13) Ex <y <^ X < E^y , 

where < is the partial order on or M^^^^, which can be deduced from 

eij + Xj < yi yi,j <4> Xj < -eij + yi WiJ . 

As a consequence, the residuated operator is crucial for max-plus two-sided systems of inequalities, 
because ([13]) implies: 

(14) Ax < Bx ^ X < A^Bx . 
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Writing the last inequality explicitly, we have 

(15) Xj< A(-akj+ \/(hi+xi)) , VjG[n] . 

Thus, we obtain the same min-max function as in ([Tj). 

Moreover, positional strategies a: [m] i— )• [n] and r: [n] H> [m] correspond to affine functions B"^ 
and Aj- defined by 

f.f,. - /"^J ^ii = r{j), , . _fbij ifj = a{i), 

(lb) {Ar)ij - < . {B )ij - < , 

I —CO otherwise, I — oo otherwise. 

Recasting (llOp in max(min)-plus algebra, we obtain 

(17) may.xiA^B") = xi^^B) = minx(^l-B) . 

The following result, obtained by Akian, Gaubert and Guterman, relates solutions of Ax < Bx 
and nonnegative coordinates of xi^'^B). These coordinates correspond to winning nodes of the 
mean payoff game: if the game starts in these nodes, then Max can ensure nonnegative profit with 
any strategy of Min. 

Theorem 5 f |AGG09[ Th. 3.2]). Let A,B e M^ax" satisfy Assumptions 1 and 2. Then, Xi{A^B) > 

if and only if there exists x G I^max such that Ax < Bx and Xi ^ —oo. 

This is derived in jAGG09j from Kohlberg's theorem. The vector x is constructed by taking an 
invariant half-line, t i-^ v + tx, setting Xi = Vi + txi for t large enough if Xi > 0, and Xi = —oo 
otherwise. 

Theorem [5] shows that to decide whether Ax < Bx can be satisfied by a vector x such that 
Xi 7^ — oo, we can exploit a mean payoff oracle, which decides whether i is a winning node of the 
associated mean payoff game and gives a winning strategy for player Max. This oracle can be 
implemented either by using the value iteration method, which is pseudo-polynomial jZP96j . by 
the approach of Puri (solving an associated discounted game for a discount factor close enough to 

1 by policy iteration |Pur95] ). by using the policy iteration algorithm for mean payoff games of 
ICTGG991 [GG981 IDG06j . or the one of jBV07| . 

In tropical linear algebra, there is no obvious subtraction. However, for any E G M" " we can 
define the Kleene star 

(18) E* := "(J - E)-^'' = I\J Ey E'^y ■■■ (max-plus) , 

and analogously with A in the min-plus case. In (|18|) . / is the max-plus identity matrix with 
entries on the main diagonal and —oo off the diagonal, and the powers are understood in the 
tropical (max-plus) sense. Due to the order completeness of M, the series in (fTSl) is well-defined for 
all matrices. Note that in m"^", X = E* \s & solution of the matrix Bellman equation X = EXV I. 
Similarly, x = E*h is a solution of x = Ex V h. Indeed, if z > Ez V h, then we also have 

z>Ezyh>E'^z\/Eh\/h>---> E''+^z V E^h V E^~^h V • • • V /i , 

so that z > E*h for all such z. We sum this up in the following standard proposition. 

Proposition 6 (See e.g. |BCUQ92t Th. 3.17]). Let E € M"""" and h G 1". Then, E*h is the least 
solution of z > Ez V h. 

For E G M"^", consider the associated digraph T){E), with set of nodes [n] and an arc connecting 
node i with node j whenever e^j is finite, in which CctSG €-ij IS the weight of this arc. We shall say 
that node i accesses node j if there exists a path from i to j in T>{E). 
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The maximal (minimal) cycle mean is another important object of tropical algebra. For E € 

max ^min 



pnxn ^ R'^^;^), it is defined as 



^max(^^ = max max ^'^^^ ^ ' " ^ ^^"^^ (max-plus) , 

, , ke[n] ii,...;ih k 

(19) 

^x"^'''{E) = min min '''^'^ , ""'^'^ (min-plus) . 

fcg[n] ti:---,ik k 

Denote by fif^^^{E) (/xf™(-E')) the maximal (minimal) cycle mean of the strongly connected com- 
ponent of T>{E) to which i belongs. These numbers are given by the same expressions as in (I19p . 
but with ii, . . . ,ik restricted to that strongly connected component. Using fj,f^'^^{E) (//™™(£^)), we 
can write explicit expressions for the cycle-time vector of a max-plus (min-plus) linear function 
X 1—7' Ex: 

xf'^^iE) = max{/x™''''(£') | i accesses j} (max-plus), 

(20) 

^ ' xT'^iE) = mm{fif'''{E) \ i accesses j} (min-plus). 

See ICTCG+ 98] or [HOvdWOSj for proofs. Importantly, these cycle-time vectors of max-plus and 



min-plus linear functions appear in (jlOp . 

Finally, note that (jl9p and (j20p can be deduced from ([6|) if cr or r is fixed. 

Remark 1. Observe that any entry of E^ in max-plus (resp. min-plus) algebra expresses the 
maximal (resp. minimal) weight of paths with k arcs connecting node i with node j in T){E). It 
follows then from (|18p that any entry {i,j) of E* , for i ^ j, expresses the maximal (or minimal) 
weight of paths connecting node i with node j without restrictions on the number of arcs. Further 
we can add to T){E) a new node and, whenever hi if finite, an arc of weight hi connecting node 
i of T>{E) with this new node. Then, {E*h)i provides the maximal (or minimal) weight of paths 
connecting node i with the new node. Therefore, computing E*b is equivalent to solving a single 
destination shortest path problem, which can be done in O(n^) time (for instance by the Bellman- 
Ford algorithm). 

Remark 2. We note that x^'^^iE) and x"^™{E) can also be computed in O(n^) time. To do this, 
decompose first the digraph "DIE) in strongly connected components, and apply Karp's algorithm to 
compute the maximal or minimal cycle mean of each component. 

3. Tropical linear-fractional programming 

This is the main section of the paper. Here we solve the tropical linear-fractional programming 
problem ([3]), i.e. the problem 

minimize (px V r) — (qx V s) 

(21) 

subject to: Axyc<Bxyd,xe R^^^ 



where p, q € M^^ax, c,de M™,„ r, s € R^^ax and A, Be M^^x"- 

In Subsection 13. H we apply Theorem [5] to reduce (j2ip to the problem of finding the smallest zero 
of a function giving the value of a parametric game (the spectral function) . 

In Subsection 13.21 we show that the spectral function is 1-Lipschitz and piecewise linear, and 
that it can be written as a finite supremum or infimum of partial spectral functions, corresponding 
to one player games. We also prove a number of technical statements about the piecewise-linear 
structure of the spectral functions, which will be used in the complexity analysis. 

In Subsection 13. 3| we provide certificates of optimality and unboundedness (these certificates 
are given by strategies for the players). This generalizes the result of [AGKllb] . concerning the 
tropical analogue of Farkas lemma. We recover as a special case the unboundedness certificates 

of HSoH]. 
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The rest of the section is devoted to finding the least zero of the spectral function. With this 
aim, we introduce a bisection method, as well as a Newton-type method, in which partial spectral 
functions play the role of derivatives, see Subsection 13. 4[ 

Each Newton iteration consists of 

(i) Computing a derivative, i.e. choosing a strategy for player Max (or dually Min) which satisfies 
a local optimality condition; 

(ii) Finding the smallest zero of the tangent map, which represents the parametric spectral func- 
tion of a one-player game in which the strategy for player Max (or dually Min) is already 
fixed. 

The iteration in the space of strategies for player Max has an advantage: the second subproblem 
can be reduced to a shortest-path problem (Subsection 13. 5p . The first subproblem is discussed in 
Subsection l3.61 where the overall worst-case complexity of Newton method is given. Subsection l3.7t 
which can be skipped by the reader, gives an alternative approach to the first subproblem in which 
the computation of (left) optimal strategies is rather algebraic and not relying on the integrality. 



3.1. The spectral function method. In this subsection we recast (j2ip as a parametric two-sided 
tropical system and a mean payoff game, introducing the key concept of spectral function. However, 
before doing this we need to mention special cases in which there exists a feasible x (i.e., satisfying 
Ax V c < Bx V d) such that px\/ r = — oo or qx\/ s = — oo. For these cases we assume the following 
rules: 

{px V r) — {qx V s) 



pxM r 



qxy s 



finite 

— oo 
— oo 



— oo 
-|-oo 
— oo 



— oo 

which are formally consistent with the rules of Kmax- Then, it is easy to check that 
(23) {px V r) - {qx V s) = min{A G Mmax \ px y r < X + {qx y s)} . 

Introducing the notation 

we reformulate the tropical linear-fractional programming problem in terms of a spectral function, 
which gives the value of a parametric mean payoff game: the payments are given by the matrices 
U and V{X), and the initial node is n + 1. 

Proposition-Definition 7. With assumption (j22p . the tropical linear-fractional programming 
problem ()2ip is equivalent to 

(25) min{A € M^ax | 0(A) > 0} 

where the spectral function (j) is given by 

4>{X) ■.= xn+i{u^v{X)) . 

Proof. We first show that (I2ip is equivalent to the following problem: 
minimize A 

subject to: px V r < X + {qx y s) , Ax \/ c < Bx V d , x e M^ax ^ A € Mmax 
Indeed, denoting P = {x € K^ax I V c < Bx yd}, we verify that 

mm{{px y r) — {qx V s)} =minmin{A | px V r < A + {qx V s)} 

= min{3x € P | V 7' < A + {qx V s)} . 
A 
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Every problem concerning afRne polyhedra has an equivalent "homogeneous" version concerning 
cones, which is obtained by adding to the system of inequalities defining an affine polyhedron a 
new variable whose coefficients are the free terms of this system. Then, the original polyhedron is 
recovered by setting this new variable to 0. The homogeneous equivalent version of (j26p reads: 

minimize A 

(27) 

subject to: uy < X + vy , Cy < Dy , y.„+i ^ -oo , y G M^tx > ^ S Mmax 

where we set u = [p,r], v = [(/, s], C = [A, c] and D = [B, d]. 
We can still reformulate ()27p in a more compact way: 

min{A G Mmax \Uy < V{X)y , y„+i / -oo is solvable} , 

with U and V{X) defined in ()24p . Finally, by Theorem [5l it follows that Uy < V{X)y is solvable 
with finite yn+i if, and only if, Xn+i{U^V{X)) > 0. □ 

Remark 3. Butkovic and Aminu |BA08j considered the following special cases of (j2ip ; 

minimize px [resp. maximize qx) 
subject to: AxVc<Bx\/d,xe M" 

j^mxn /jQ^g g^iy jirfiHg entries. Clearly, 
for minimization, or respectively s = 



(28) 



where p,q e M", c,d e R"\ r,s £ R and A, B e M™^'" have only finite entries. Clearly, (|2T]1 
becomes (|28p if we set r = — oo, q = — oo and s = for minimization, or respectively s = —oo, 
p = —oo and r = for maximization, where the opposite (tropical inverse) of the minimal value of 
X equals the maximum of qx. 

In this connection, formulation (|27p ( or equivalently (|2ip ) has a good geometric insight, mean- 
ing optimization for general tropical half-spaces (or hyperplanes) defined by bivectors {u,X + v), 
see |GK09t lAGKllb] for more background. 

Example 1. Assume we want to maximize (1 + xi) V (3 + X2) over the tropical polyhedron o/M^ax 
defined by the system Ax V c < Bx V d, where 



A 



I 



\ 



-00 
-2 
-1 




-1 
-2 

-00 
-00 



v 



-00 
-00 
-00 
-00 



\ 



B 



( 



\ 





-00 
-00 
-00 



-00 
-00 



2 








This tropical polyhedron is displayed on the left-hand side of Figure [21 below. This maximization 
problem is equivalent to minimizing X subject to < A + ((l + xi)V (3 + 2:2)), AxWc < BxMd. Indeed, 
the value of the latter problem is the opposite (tropical inverse) of the value of the maximization 
problem. The homogeneous version of this minimization problem reads: 
minimize X 

(29) / . _ , 



-00 , y G 



A G 



subject to: uy < X + vy , Cy < Dy , y^ / 
where C = [yl, c], D = [i?, d], u = (—00, —00, 0), and v = (1, 3, —00). 

3.2. Partial spectral functions and piecewise linearity. We have shown that solving the 
tropical linear-fractional programming problem (|2ip is equivalent to finding the least zero of the 
spectral function </>(A) := Xn+i(f^''^(A)). Here we will analyze the graph of this spectral function, 
after introducing analogues of derivatives, the partial spectral functions. 

Given a strategy o" G 5 for player Max and a strategy r G T for player Min, we respectively define 
the min-plus linear function U'^V'^{X) and the max-plus linear function UrV{X), see Q and ()16p . 
We introduce the partial spectral functions 4>^{X) 
With this notation, (fT7|) yields 



Xn+i(^7tty-(A)) and 0,(A) := Xn+i{mV{X)). 



(30) 



max (j)'^{X) 

crgS 
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tGT 



Figure 2. A partial spectral function (left) and a spectral function (right). 



Partial spectral functions can be represented as in where one of the strategies is fixed, see 
also ([20]): 

(31) (/>'^(A) = min$[/^y(;^)(n+ l,r,cj) , 0^(A) = max$[7^y(;^)(n + l,r,cr) . 

A graphical presentation of (1311) and pOI) using only (pr is given in Figure [2l 
Let Qx be the bipartite digraph of the mean payoff game whose payments are given by the 
matrices U and V{X), see Figures [3] and H] below for illustrations. Observe that in this digraph, 
only the weight of the arcs connecting node m + 1 of Max with nodes ? G [n + 1] of Min depend 
on A. Recall that given a strategy a for player Max (resp. r for player Min), Gx (resp. QJ^) denotes 
the bipartite subdigraph of Qx obtained by deleting from Qx all the arcs (i, j) such that i £ [m + 1] 
and j a{i) (resp. the arcs (j, i) such that j G [n + 1] and i ^ T{j)). 
We next investigate the properties of spectral functions. 

Theorems. Leta: [m + 1] i— ?> [n+1] be a positional strategy for player Max and t : [?^ + l] i— >• [m + 1] 
be a positional strategy for player Min. Then, 

(i) 4>{\), 4'tW and(f)^{\) are 1-Lipschitz nondecreasing piecewise-linear functions, whose linear 
pieces are of the form (a + (5\)/k, where k € [min(m, n) + 1] and /3 G {0, 1}. 

(ii) If the absolute values of all the finite coefficients in (127p are bounded by M, then \a/k\ < 2M . 
(Hi) (prW is convex and 4''^{X) is concave. Both functions consist of no more than min(m, n) + 2 

linear pieces. 

Proof. As follows from (130p and (j3ip . spectral functions are built from the finite number of functions 
A I—)- ^u,V{\) ("^ + li '^1 ''")) each of which is given by the mean weight per turn of the only elementary 
cycle in Q"^'^ accessible from node n + 1 of Min. Recall that Q"^'^ is the subdigraph of Qx where all 
arcs at all nodes except for those chosen by player Max (strategy a) and player Min (strategy r) are 
removed. As a function of A, this mean weight per turn is a line {a+ /3\)/k. Here k G [min(m, n) + l] 
since the length (i.e., the number of nodes of Max it contains) of any elementary cycle in the bipartite 
digraph Qx does not exceed both m + 1 and n + 1. Also /3 G {0, 1}, because an elementary cycle 
can contain node m + 1 of Max no more than once. If the absolute values of all the payments in 
the game are bounded by M, then \a/k\ < 2M since the arithmetic mean of payments, counted 
per turn, does not exceed the greatest sum of two consecutive payments. 

Thus, the functions A >->■ $(/,V(A)('^ + l;'^;''") satisfy all the properties of ^ and (jn]). Using ([30]) 
and ([3T]) we conclude that (piX), (priX) and (p'^iX) also satisfy these properties. 

Convexity (resp. concavity) of (pr (resp. (j)"') follows from ()3ip . In a convex or concave piecewise- 
linear function, each slope can appear only once, while the possible slopes are 0, 1, 1/2,..., 
l/(min(m, n) + 1). This shows ([mj) . □ 

Some useful facts can be deduced further from this description of spectral functions. 

Corollary 9. Spectral functions satisfy the following properties: 
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(i) If the absolute values of all coefficients in (|27p are either infinite or bounded by M , then 
(p{X), 4>'^{X) and (/>r(A) are linear for A < —AM (min(m, n) + 1)^ and for A > AM (min(m, n) + 
1)^ 

(a) If the absolute values of all coefficients in (j27p are either infinite or bounded by M , then the 
solutions to the problems min{A | (t){X) > 0}, min{A | </>'^(A) > 0} and min{A | 4>t{X) > 0} lie 
(if finite) in [— 2M(min(m, n) + 1), 2M(min(m, n) + 1)] . Moreover, if all the finite coefficients 
are integers, then the solutions to all these problems are integers as well. 
(Hi) If the finite coefficients in (j27p are integers, then the breaking points of (p{X), (p^{X) or (/>r(A) 
are rational numbers whose denominators do not exceed min(m, n) + 1. 

(iv) If the finite coefficients in ()27p are integers with absolute values bounded by M, then 0(A) 
consists of no more than 8M(min(m, n) + 1)^ + 2 linear pieces. 

Proof. (ji|) Consider the intersection point fi of one linear piece (ai + l3iX)/ki with another hnear 
piece (a2 + P2X)/k2. By Theorem [HI ki,k2 < mm{m,n) + 1 and |, |a2/^2| ^ 2M, and we 

obtain from 

\Pi/ki - h/k2\ > ^— T2 , \ai/ki - a2/k2\ < AM , 

(mm(m, n) + Ij^ 

that 1^1 < 4M(min(m, n) + 1)^. This means that (/'(A) is Unear for A > 4M(min(m,n) + 1)^ and 
A < — 4M(min(m,n) + 1)^. (Note that this part did not impose the integrahty of coefficients.) 

([n]) Note that due to piecewise-hnearity, the solution to each of these problems (if finite) is given 
by the intersection point of a certain linear piece of the form (a + X)/k with zero. Then, since 
\a/k\ < 2M and k < min(m,n) + 1 by Theorem [8l we conclude that this intersection point —a 
lies in [— 2M(min(m, n) + 1), 2M(min(m, n) + 1)]. Moreover, if the finite coefficients in ()27p are 
integers, then this solution —a is also integer. 

By Theorem [HI spectral functions are piecewise linear and the linear pieces are of the form 
(a + f3X)/k, where in particular k € [min(m,n) + 1] and (3 € {0, 1}. Considering the intersection 
point /X of one such piece (ai +/3iA)/fci with another piece {0.2 + hX) /k2 and assuming the integrity 
of ai,a2 we obtain that ^ = (^102 — ^2Cki)/(A;2/3i — A:i/32) is a rational number with denominator 
not exceeding min(m, n) + 1. 

(p^ The denominators of breaking points do not exceed min(m, n) + 1, and hence the difference 
between their inverses is not less than l/(min(m,n) + 1)^. This is a lower bound for the difference 
between two consecutive breaking points. We get the claim applying part (ji|) . □ 

Note that to determine the slope of 0(A) at +00, meaning for A > 4M(min(m,n) + 1)^, or at 
—00, meaning for A < — 4M(min(m, n) + 1)^, we can set all the finite coefficients in (j27p to 0. Then, 
we "play" the mean payoff game at A = 1 or at A = —1, respectively. 

Denote by MPGI(m, n, M) the worst-case complexity of an oracle computing the value of mean 
payoff games with integer payments whose absolute values are bounded by M, with m nodes of Max 
and n nodes of Min. There exist pseudo-polynomial algorithms computing the value of mean payoff 
games. For instance, in |ZP96| the authors describe a value iteration algorithm with 0{mn^M) 
complexity. Using this we now show that all the linear pieces of a spectral function can be identified 
in pseudo-polynomial time. Note that we do not require the oracle to compute optimal strategies 
here. 

Proposition 10. Let all the finite coefficients in (j27p be integer with absolute values not exceeding 
M. Then, all the linear pieces that constitute the graph of (j){X) can be identified in 

0{Mimn{m,nf) x MPGI(m + l,n+ 1, Af (min(m, n) + 1)(1 +4(min(m,n) + 1)^)) 

operations. 

Proof. By Corollary [9] part dm]), the breaking points of 0(A) are rational numbers whose denom- 
inators do not exceed min(m,n) + 1. To identify the linear pieces that constitute the graph 
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of the spectral function, we only need to evaluate (f){X) on such rational points in the interval 
[— 4M(min(m, n)+l)^, 4M(min(m, n)+l)^], the number of which does not exceed 0{M min(m, n)^). 

Further, when computing 0(A), the payments in the mean payoff games that the oracle works 
with are either a or a + A, where a is an integer satisfying \a\ < M and A is a rational number in 
[— 4M(min(m, n) + 1)^, 4M(min(m, n) + 1)^] whose denominator does not exceed min(m,n) + 1. 
The properties of the game will not change if we multiply all the payments by this denomina- 
tor, obtaining a new game in which the payments are integers with absolute values bounded 
by (min(m,n) + 1)(M + 4M(min(m,n) + 1)^). Then, the complexity of the mean payoff ora- 
cle will not exceed MPGI(m + l,n + 1, (min(m,n) + 1)(M + 4M(min(m, n) + 1)^)). Multiplying 
by 0{M min(m, n)^) we get the claim. □ 

Remark 4. It follows that the tropical linear-fractional programming problem (j27|) can be solved 
in pseudo-polynomial time by reconstructing all the linear pieces that constitute the graph of 4>{X) ■ 
However, more efficient methods will be described in Subsection \3.4\ 

Remark 5. A similar spectral function has been introduced in |GS10j to compute the set of solutions 
A of the two-sided eigenproblem Ax = XBx. The present approach can be extended to a larger class 
of parametric games, in which the payments are piecewise affine functions of the parameter X, with 
integer slopes. See jSerlO| . 

3.3. Strategies as certificates. In the classical simplex method, the optimality of a feasible 
solution is certified by the sign of Lagrange multipliers. In the tropical case, following the idea 
of [AGKllbj . we shall show that the certificate is of a different nature: it is a strategy. We shall 
also use such strategies to guide the next iteration of Newton method in Subsection 13. 4|, when the 
current feasible solution is not optimal. 

Definition 11 (Left and right optimal strategies). A strategy a— for player Max (resp. r— for 
player Min) is left optimal A € if there exists e > such that 

</*(/") = '/''^"(Z^) {resp. (j){fi) = 0r-(/-f)) G [A - e. A] . 

Right optimal strategies 0"+ and r+ are defined in a similar way, replacing [X — e, A] by [A, A + e]. 

The existence of left and right optimal strategies at each point follows readily from (I30p . together 
with the finiteness of the number of strategies and the piecewise affine character of each function 
0'^(A) and 0^(A). 

Theorem 12. The tropical linear-fractional programming problem (j27p has the optimal value X* S 
M if, and only if, (j){X*) > and there exists a strategy r for player Min such that the digraph Q'^, 
satisfies the following conditions: 

(i) all cycles accessible from node n + 1 of Min have nonpositive weight, 

(a) any cycle of zero weight accessible from node ?i + 1 of Min passes through node m + 1 of Max. 
Moreover, these conditions are always satisfied when r is left optimal at A*. 

Proof. The tropical linear-fractional programming problem ()27p has the optimal value A* if, and 
only if, (t){X*) = and (j){X) < for all A < A*. If r is any left optimal strategy at A*, then the 
previous conditions are satisfied if, and only if, (priX*) = and (priX) has nonzero left derivative at 
A*. 

By (j3ip . or ()19p and ()20p . we know that 0t(A) is the maximal cycle mean (per turn) over all 
cycles in QJ^ accessible from node n + 1 of Min. It follows that (priX*) = if, and only if, all cycles 
in C/J* accessible from node n + 1 of Min have nonpositive weight and at least one of them has zero 
weight. Moreover, (priX) has nonzero left derivative at A* if, and only if, any zero- weight cycle in 
GJ^, accessible from node n + 1 of Min has arcs with weights depending on A, which can only occur 
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if it passes through node m + 1 of Max. Thus, the conditions of the theorem are necessary and 
they are satisfied by any left optimal strategy r at A*. 

Assume now that there exists a strategy r satisfying the conditions of the theorem. Then, the 
argument above shows that 0r(A*) < and 0t(A) < for all A < A*. Since (/>(A*) > and by ([30]) 
we have 4>{X) < 4>tW for all A, it follows that (p{X*) = and 4>{X) < for all A < A*. Therefore, 
A* is the optimal value of the tropical linear- fractional programming problem (|27p . □ 

In the same way, we can certify when the tropical linear-fractional programming problem (]27p is 
unbounded. 

Theorem 13. The tropical linear-fractional programming problem (I27p is unbounded if, and only 
if, there exists a strategy a for player Max such that all cycles in the digraph Qq accessible from 
node n + \ of Min do not contain node m+1 of Max and have nonnegative weight. 

Proof. We know that the tropical linear-fractional programming problem (|27p is unbounded if, and 
only if, 0(A) > for all A. By the first equality in (j30p . the latter condition is satisfied if, and only 
if, there exists a strategy a for player Max such that (/''^(A) > for all A. Note that the weight of 
a cycle in Q"^ that passes through node m + 1 of Max can be made arbitrarily small by decreasing 
A, because this cycle must contain an arc whose weight depends on A. Therefore, using the fact 
that i?i>'^(A) is the minimal cycle mean (per turn) over all cycles in Q'^ accessible from node n-|- 1 of 
Min (see ([311), or ([19]) and it follows that (p^iX) > for all A if, and only if, all cycles in 

accessible from node n + 1 of Min have nonnegative weight and do not pass through node m + 1 of 
Max. □ 

Remark 6. Theorems [T^ and{I^ are inspired by Theorem 18 and Corollary 20 of [AGKllb] . in 

which similar certificates are given for the problem of checking whether an implication of the form 
Ax < Bx px < qx holds. The latter can be cast as a special tropical linear-fractional 

programming problem. 

Example 2. Consider the tropical linear programming problem given by the minimization of (2 -|- 
^i) V (—4 -|- X2) over the tropical polyhedron o/M^^x defined by the system of inequalities Ax V c < 
Bx V d, where 
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This polyhedron is displayed on the left-hand side of Figure below. The direction of minimization 
0/ (2-|-a;i) V (— 4 + X2) is shown there by a dotted line above the polyhedron, together with the optimal 
tropical hyperplane (2 + xi) V (— 4 + 2:2) = 0. The bipartite digraph Qx corresponding to this problem 
is depicted in Figure O where the nodes of Max are represented by squares and the nodes of Min 
by circles. Note that in this case we have m = 7 and n = 2. 

The equivalent homogeneous version of this problem ( as described in Subsection \3.1\) is to min- 
imize X subject to uy < A + vy, Cy < Dy, and ^ —00, where C = [A,c\, D = [B,d], 
u = (2, —4, —00) and v = (—00, —00, 0). 

Thanks to Theorem it is possible to certify that X* = is the optimal value of this problem. 
To show this, consider the strategy t for player Min defined by: r(l) = 8, r(2) = 4 and r(3) = 4, 
which is represented in bold in Figure El Observe that the resulting subdigraph QJ^* contains only 
one cycle, which is accessible from node n+1 of Min (indeed it passes through this node), has zero 
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Figure 3. The bipartite digraph Qx of the mean payoff game associated with the 
tropical hnear programming problem of Example [2j Special nodes n + 1 and m + 1 
are in bold as well as a strategy r for player Min certifying the optimality of A* = 0. 
The subdigraph QJ^^. is obtained by deleting the dashed arcs. 

weight and passes through node m + 1 of Max. Moreover, by Theorem\^ we have > because 

y = (—2, 2, 0)"^ satisfies Cy < Dy and uy < X* + vy = vy. Therefore, by Theorem\l^ X* = Q is the 
optimal value. 

The special cases (I28p of the tropical linear-fractional programming problem (]27p have been 
studied in |BA08] . where necessary and sufficient conditions for these problems to be unbounded 
were in particular given. We next show that under the assumptions of |BA08] . which require the 
entries of all vectors and matrices to be finite, these conditions turn out to be equivalent to the one 
given in Theorem [T3l 

Theorem 3.3 of |BA08] shows that, when only finite entries are considered, the minimization 
problem in (I28p is unbounded if, and only if, c < d. Under the finiteness assumption, this condition 
is equivalent to the one given in Theorem [131 To show this, in the first place observe that in this 
case the associated digraph Qx (see Figure U]) contains arcs connecting any node of Min [n + 1] 
with any the node of Max [m + 1], with exception of the arc connecting node n + 1 with node 
m + 1, and arcs connecting any node of Max [m + 1] with any node of Min [n + 1], with exception 
of the arcs connecting node m + 1 with nodes in [n]. Thus, if we define the strategy a for player 
Max by a{i) = n + 1 for all i G [m + 1], it can be checked that the only cycles in Qq accessible 
from node n + 1 are of the form n + 1— T-ii^n + l— >-n + l— )-ifc^n+l for some 
ii, . . . ,ik G [m] . Since the weight of such a cycle is dj^ — Cj^ + • • • + di^, — Ci^, , the strategy a satisfies 
the conditions in Theorem [13] if c < d. Conversely, assume that a strategy a for player Max satisfies 
the conditions in Theorem 1131 Then, the only possible value for a{m + 1) is n + 1, and we must 
also have a{i) = n + 1 for all i G [m], because if a{i) = j / n + 1 for some i G [m], Qq would 
contain the cycle m + 1— T-n + l— 7>i^j^m + l, contradicting the fact that no cycle accessible 
from node n + 1 of Min passes through node m + 1 of Max. Now, since Qq contains the cycles 
n + 1— T-i— )-n + l for i G [m], which are accessible from node n + 1 of Min, the weights of these 
cycles di — Ci must be nonnegative, implying that c < d. 

Regarding the maximization problem in (I28p . Theorem 3.4 of |BA08| shows that this problem 
is unbounded if, and only if, the system Ax < Bx has a finite solution. In this case, due to 
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Figure 4. On the left: the bipartite digraph of the mean payoff game associated 
with the tropical linear programming problem (I26p . The nodes of Max are repre- 
sented by squares and the nodes of Min by circles. In the middle and on the right: 
the bipartite digraphs of the special cases (j28p . for the minimization problem and 
the maximization problem, respectively. 



the finiteness assumption, it follows that the associated digraph G\ (see Figure H]) contains arcs 
connecting any node of Max [m + 1] with any node of Min [n + 1], with exception of the arc 
connecting node m + 1 with node n + 1, and arcs connecting any node of Min [n + 1] with any 
the node of Max [m + 1], with exception of the arcs connecting nodes in [n] with node m + 1. If 
the system Ax < Bx has a finite solution, from Theorem [5] and (jl7p it follows that there exists 
a strategy a -^[m] ^ [n] such that xiA'^B^) = x{A^B) > 0- By ([19]) and ([20]), this imphes that 
any cycle in Q'^ has nonnegative weight, where Q is the bipartite digraph of the mean payoff game 
associated with the matrices A and B. If we define the strategy a{i) = a{i) for all i G [m] and 
a{m + 1) = j for some j G [n], then a satisfies the conditions of Theorem 1131 because the cycles 
accessible from node 77, + 1 of Min in Qq are precisely the cycles in Q'^ and there is no cycle containing 
node m + 1 of Max in Qq. Conversely, if a strategy a for player Max satisfies the conditions in 
Theorem 1131 then necessarily we have a{i) € [n] for all i G [m], because if cr(i) = n + 1 for some 
i € [m], Gq would contain the cycle ri+l— )-?ti+1— >j— )-7— )-n+l where j = a{m + 1) € [n], 
contradicting the fact that there is no cycle in Qq accessible from node n + 1 of Min passing through 
node m + 1 of Max. Now, if we define a{i) = a{i) for all i G [m], the cycles accessible from node 
n + 1 of Min in Qq are precisely the cycles in C?*^, which therefore have nonnegative weight. Then, 
by (fT9l) and (f20l) we have x{-^^B'^) ^ 0) and so from Theorem [5] and (fT7|) we conclude that the 
system Ax < Bx has a finite solution. 

Remark 7. If the strategies a or t and the scalar A* are fixed (considered as inputs) the conditions 
of Theorems{T^ and \13\ i.e. the validity of the certificates, can be checked in polynomial time. 

To see this, in the first place assume that r and X* are given. Using Karp's algorithm, compute 
the maximal cycle mean of each strongly connected component of QJ^, that is accessible from node 
n + 1 of Min. The certificate is valid only if these maximal cycle means are nonpositive and one 
of them is zero. To check the second condition of Theorem delete node m + 1 of Max ( and the 
arcs adjacent to it) from Gx* and compute for the resulting digraph (using again Karp's algorithm) 
the maximal cycle mean of each strongly connected component accessible from node n + 1 of Min. 
To be valid, all these maximal cycle means must be negative. Observe that in Theorem [13 also 
assume that > 0. By (j30p . this can be certified by a strategy a for player Max such that the 

minimal cycle mean of any strongly connected component of Q^* accessible from node n + 1 of Min 
is nonnegative, which can be checked by applying Karp 's algorithm to each of these components. 
By Theorem\^ another possibility is to exhibit a vector y such that Cy < Dy, uy < X* + vy and 

Vn+l 7^ -00. 

Assume now that a is given. To check the validity of the certificate in Theorem \1S\ decompose 
first Qq in strongly connected components and see whether the component containing node m+ \ of 
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Max is trivial (i.e. contains just this node) or it is not accessible from node n + 1 of Min. If this 
is the case, compute the minimal cycle mean of each strongly connected component of Qq accessible 
from node n + 1 of Min by applying Karp 's algorithm. Then, the certificate is valid if each of these 
minimal cycle means is nonnegative. 

3.4. Bisection and Newton methods for tropical linear- fractional programming. In (p5]) . 
we need to find the least A such that (/'(A) > 0, where (j){X) is nondecreasing and Lipschitz continuous. 
Thus, we can consider certain classical methods for finding zeroes of "good enough" functions of 
one variable. In particular, the bisection method for (/'(A) corresponds to the approach of |BA08] . 
More specifically, it can be formulated as follows, when the finite coefficients in (|27p are integers. 

Algorithm 1. Bisection method 

Start. A point Aq such that (j){Xo) > and a point Aq such that (pi^o) < 0. 

Iteration k. Let A = \{Xk~i + \k^i)/2] . If (f){\) > 0, then set A^ = A andX^ = Xj^^i. Otherwise, 
set Afc = Afe_i and A^ = A. 

Stop. Verify \k — — 1- tfue, return Afe. 

For this method, which uses that tropical linear-fractional programming preserves integrity 
(Corollary [9] part ()iv|) ). it is not important to know the actual value of (/>(A), but just whether 
(/)(A) > 0, i.e. whether Uy < V{X)y is solvable with y„+i ^ — oo. 

Further, the concept of (left, right) optimal strategy, see Definition [TT\ yields an analogue of 
(left, right) derivative, and leads to the following analogue of Newton method, which does not have 
any integer restriction. 

Algorithm 2. Positive Newton method 
Start. A point Aq such that (j){Xo) > 0. 

Iteration k. Find a left optimal strategy a for player Max at X^-i and compute X^ = min{A G 

M^ax I r{X) > 0}. 

Stop. Verify X^ = Xk~i or X^ = —oo. If true, return A^. 

It remains to explain how each step of this algorithm can be implemented. We shall see that 
Afc can be easily computed (reduction to a shortest path problem) and that finding left optimal 
strategies can be done by existing algorithms for mean payoff games. 

For the sake of comparison, we state a dual version of Algorithm [2j 

Algorithm 3. Negative Newton method 
Start. A point Aq such that <^(Ao) < 0. 

Iteration k. Find a (right) optimal strategy r for player Min at Xk-i and compute Xk = min{A G 

Minax I <^r(A) > 0}. 

Stop. Verify (j){Xk) = or Xk = +00. // true, return Xk. 

Remark 8. Note that in Algorithmic we can use optimal strategies instead of right optimal ones, 
because if t is optimal at Xk-i, we have ^^(Afc-i) = (piXk-i) < and so Xk > Xk-i by the definition 
of Xk (recall that by Theorem\^all the spectral functions are nondecreasing and piecewise-linear). 
This means that all the strategies considered in the iterations of Algorithmic are different, and as 
the number of strategies is finite, this algorithm must terminate in a finite number of steps. A 
similar argument shows that we can also use optimal strategies in Algorithmic at points Xk-i where 
the spectral function (j) is strictly positive, because in that case we have Xk < Xk-i even if a is 
just optimal and not left optimal (however, when <j){Xk~i) = and Xk-i is not optimal, only a left 
optimal strategy at Xk-i guarantees Xk < Xk-i). 

Remark 9. Due to Corollary O part (jn]), the values A^ := 2M(min(m, n) + 1) and X~ : = 
— 2M(min(m, n) + 1) can be first checked in the case of the positive and negative Newton meth- 
ods, respectively. We recall that M is a bound on the absolute value of the coefficients in (I27p . 
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If (j){X~^) < then the problem is infeasible, and if > then the problem is unbounded. 

If (j){X^) > and </>(A~) < 0, then the problem is both feasible and bounded. The case = 

requires a left optimal strategy for player Max at A~ to decide that either this point is optimal, or 
the problem is unbounded. 

This rule of starting with ±2M(min(m, n) + 1), as we shall see, secures pseudo-polynomiality of 
the instances of the mean payoff games generated by the bisection and Newton methods. 

The following logarithmic bound on the complexity of the bisection method is standard and its 
proof will be omitted. 

Proposition 14. // the finite coefficients in (|27p are integers with absolute values bounded by M, 
then the number of iterations of the bisection method does not exceed log(4M(min(m, n) + 1)) if it 
is started as in Remark\^ Hence, the computational complexity of the bisection method in this case 
does not exceed 

log(4M (min(m, n) + 1)) x MPGI(m + 1, n + 1, M + 2M (min(m, n) + 1)) . 

Remark 10. Butkovic and Aminu |BA08j give better initial values \q and Ag for the bisection 
method than ±2M(min(m, n) + 1), but only for the special cases (|28p . where all the coefficients 
are assumed to be finite. These initial values depend on the input data and lie in the interval 
[— 3M, 3M]. As oracle, they exploit the alternating method of |CGB03] . which requires 0{mn[m + 
n)M) operations, being related to the value iteration of |ZP96] . Hence, in this case, the complexity 
of the bisection method is no more than 0{mn{m + n)M log M). In |SerlOj . the same kind of 
initial values were obtained for the general formulation (j2ip . leading to a similar complexity, but 
with the same finiteness restriction on the coefficients. The initial values of |BA08j and [SerlOj will 
be exploited in the numerical experiments, see Subsection \4.3\ 

As observed above, in the case of the bisection method the mean payoff oracle is only required 
to check whether (p{X) > 0. 

In the case when the finite coefficients in (j27p are real, the bisection method computes (A^^i + 
^k-i)/'^ without rounding and it yields only an approximate solution to the problem. However, 
Newton methods always converge in a finite number of steps. 

Proposition 15. Denote by \S\ and \T\ the number of available strategies for players Max and 
Min, respectively. Then, 

(i) Algorithms\^and\^ terminate in a finite number of steps, the number of which does not exceed 
\S\ and \T\, respectively. 

(a) If the finite coefficients in (j27p are integers with absolute values bounded by M, then the 
values Afc produced by Algorithm are also integer, and the number of iterations does not 
exceed 4M(min(m, n) + 1) if it is started as in Remark\^ 

Proof. (ji|) At different iterations of Algorithm [2] we have different strategies, because A^ = min{A € 
l^max I <^°^(A) > 0} are different for all k. Similarly for Algorithm [3l with r instead of a. Thus, the 
number of steps is limited by the number of strategies, which is finite. 

([n]) The numbers A^ generated by Algorithm [2] are integers due to Corollary [9] part ^ . By 
Remark [9l we can start the algorithm at 2M(min(m, n) + 1), and it will finish before it reaches 
-2M(min(m,n) + 1). □ 

A worst-case complexity bound, different from the number of strategies, will be given below in 
Theorem I19| and it is worse than that of the bisection method above (see also Remark llOp. First, 
Newton iterations require more sophisticated oracles which compute the value of the game and a 
left optimal strategy. Second, we have only used the integrality of the method in Proposition [T5| 
so the bound on the number of iterations is rough. However, the positive Newton method is an 
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interesting alternative to the bisection method, since it preserves feasibihty. Therefore, it may be 
more sensitive to the geometry of the feasible set, which is especially convenient if this set has only 
few generators or its dimension is small. The experiments of Subsection 14.31 indicate that this is 
indeed the case, and the worst-case complexity bound of Theorem [19] (using Proposition I ISp is often 
too pessimistic. The main reason to give the result of Theorem [19] is that it shows the method is 
pseudo-polynomial. 

Not aiming to obtain a better overall worst-case complexity result, in the next subsection we 
will rather consider the implementation of the positive Newton method, reducing the computation 
of Afc to a (polynomial-time solvable) shortest path problem. Subsection 13.61 will be devoted to the 
computation of left optimal strategies in the integer case by means of perturbed mean payoff games. 
As noticed in Proposition [TS] Newton iterations should work also in the case of real coefficients. 
For this we propose the algebraic approach of Subsection [321 encoding a perturbed game as a game 
over the semiring of germs. 

3.5. Newton iterations by means of Kleene star. In this subsection we show that in the case 
of Algorithm [2] the steps of Newton method can be performed by calculating least solutions of 
inequalities of the form z > Ez V h, as in Proposition [6] 

Assume that we are at iteration k of Algorithm [21 so that we need to compute = min{A € 
I^max I > 0}, where a is a left optimal strategy for player Max at Afc_i. If we set V^{X) 

instead of V{X) m Uy < V{X)y, by Theorem [5] the minimal zero A^ of (j)'^{X) is exactly the least 
value of A for which this system is satisfied by some y G Mmax with yn+i 7^ — oo, i.e. we have 

(32) Afc = min{A G Mmax \Uy < y(A)y , / -oo is solvable} . 

The main idea is to compute this minimal zero by considering the system Uy < V^{X)y directly. 
With this aim, we shall need the following observation. 

Lemma 16. Assume that at iteration k of Algorithmic we have I := a{m + 1) ^ n + 1, where a is 
a left optimal strategy for player Max at Xk-i- Then, if 



Otherwise, i.e. if Condition (I33p does not hold, Xk = —oo. 

Proof. Condition (133p implies that the minimum in (|34p is less than or equal to that in (j32p . 

To show the converse, suppose that for some A € M there exists y G Mmax such that yi ^ —oo 
and Uy < V^{X)y. Since (^°"(Afc_i) = (j){Xk~i) > 0, by Theorem [5] there exists a solution y of 
Uy < V'^{Xk-~i)y (and so, in particular, of the first m inequalities of this system, i.e. Cy < D'^y) 
such that jju+i 7^ — oo. Then, for any /3 G M the combination y = y V y — /3 satisfies the first m 
inequalities in Uy < V^{X)y (in other words, we have Cy < D"y) as a tropical linear combination 
of solutions of this system of tropically linear inequalities. Moreover, if /3 is sufficiently large, y also 
satisfies the last inequality uy < A + v'^y of the system Uy < V'^{X)y because uy < X + v'^y and 
v'^y = vi + jji > — oo. But then y satisfies Uy < V'^{X)y and > yn+i — —oo. This shows 
that the minimum in (|32p is less than or equal to that in (|34p . 

Finally, if Condition (|33p does not hold, for some A there exists a solution y of the system 
Uy < V'^{X)y such that yn+i 7^ — oo but yi = — oo. Since uy < X + v'^y = X + vi + yu this can 
only happen if uy = — oo, which implies that y satisfies Uy < V'^{X)y for any A G M, and so 
Afc = — oo. □ 

We next show how to make sure that Condition ()33p is satisfied. Note that this condition is not 
satisfied if, and only if, for some A the system Uy < V'^{X)y has a solution y with yn+i 7^ — oo 
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Afc = min{A G M, 




■max 



Uy < V''{X)y , yi + 



oo is solvable} . 



but yi = — oo. The latter implies the existence of a solution y of Cy < Dy such that yi = —oo for 
all i £ supp(n), but yn+i 7^ — oo (so in particular Condition ([33]) is satisfied if n + 1 G supp(u)). 
Eliminating from the system Cy < Dy the columns corresponding to the indices in supp(n), the 
existence of such a solution is reduced to the solvability of a two-sided homogeneous system with 
the condition yn+i 7^—00, which can be decided using a mean payoff game oracle. If this problem 
has no solution, then Condition (j33p is satisfied. Otherwise, the value of the original tropical 
linear-fractional programming problem is — cxj. 

As a consequence of the previous discussion, in what follows we assume that it has already been 
checked that Condition (|33|) is satisfied, and we explain how to perform Newton iterations in that 
case. 

Suppose that we are at iteration k of Algorithm [21 and let ex be a left optimal strategy at Xk-i- 
Then, if we set I := a{m -|- 1), by Lemma [TBI we have 

Afc = min{A G Mmax | Uy < V"{X)y , yi 7^ —00 is solvable} . 

Since the system Uy < V{\)y is satisfied by some y with yi / — cxd if, and only if, it is satisfied by 
some y with yi = (it is enough to define yi = yi — yi for alH E [n -|- 1] ) , it follows that 

Afc = min{A G Mmax \Uy < V'^{X)y , yi = is solvable} 

= min{A G Mmax I Cy < D'^y , uy < X + vi + yi , yi = is solvable} . 
Thus, setting yi = we are in the situation of problem (|28p. because A^t -|- vi is given by: 

minimize pxV r 

(35) 

^ ' subject to: Axy c< B'^x y , x e M^ax 

where p G MJ^^x) ^ I^max, c, d°' G M^^x and A, B" G M^^x" are such that 

U={^ ^) and V%X)=(^' 

\p r J \—(X) X + vi 

Here, just for the simplicity of the presentation, column / is in the place of column n + 1 when 
I ^ n + 1 (in other words, the columns of A and B'^ are respectively the columns of C and D'^ with 
exception of column c is column I of C, is column / of , r = ui and pi = Ui for i ^ I). 

We claim that the system of constraints (the second line) in (I35p has a least solution, which then 
minimizes px V r, and we explain how to find it. First note that the constraints in (|35p can be 
written as: 

{Ax)i Vci< hi^^i) + , if a{i) 7^ / , 
^ ' {Ax)i V Ci<di , if cj(i) = / . 

In order to find the least solution of this system, observe that the second subsystem can be 
dispensed with. Indeed, since (/)°"(Afc_i) = (/>(Afc_i) > 0, by Theorem [5] there exists a solution y 
of Uy < {Xk-i)y such that yn+i / —00, and so this solution also satisfies yi 7^ —00 (recall we 
assume that Condition ([33]) holds). Then, if i G KJ^^x the vector defined by Xi := yi — yi for 
i ^ I, it follows that x is a solution of (I36p . Hence, if the first subsystem has the least solution x, 
we have x<x and so x is also a solution of the second subsystem. 

To show that the first subsystem in ([36p has a least solution, first note that a system of two 
inequalities of the form 

ni + Xi y ■ ■ ■ y rin + Xn < Xi 

r2l + XiV ■ ■ ■ y r2n + Xn < Xi 



is equivalent to just one inequality: 



Si -|- xi V • • • V s„ -|- < Xi 
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where Si = ru V r2i for i = 1, . . . ,n. Using this kind of reduction, the first subsystem can be 
transformed in no more than m(n + 1) operations to an equivalent system of the form 

(37) Exi y FxjV h < XI , 

where xj is the sub- vector whose coordinates appear on the right-hand side of the first subsystem 
in (I36p . and xj is the sub- vector corresponding to the rest of the coordinates which are present 
in that system. Since we are interested in the least solution, we can set xj = — oo, and then the 
remaining system is just of the form 

(38) Ez\Jh<z , 

where z = xj. By Proposition [6l the least solution to this system in m}^^ is given by 

z = E*h = h\J EhM E'^h V E^h V • • • 

As xj satisfies ([38]) . we have z_< xj and so z G Kmlx- 
Thus, we have the following method: 

Algorithm 4. Solving (|35|) 

Step 1. Split the system Ax V c < B'^x V d"^ in two subsystems as in ()36p and transform the 
first subsystem to the form (i37|) . 

Step 2. Compute z = E*h. Set Xi = z_ and Xj = — oo. 

Step 3. Return px V r. 

We also conclude the following. 

Proposition 17. The problems min{A | (p'^{X) > 0} can be solved in 0{mn) + O(n^) time. 

Note that in general, a system of the form (|36|) is solvable in ^^g^^ if, and only if, the least 
solution of the first subsystem belongs to ^-iid satisfies the second subsystem. 

Example 3. Consider the following tropical linear-fractional programming problem: 
minimize A 

subject to: uy < X + vy , Cy < Dy , 2/4 / -00 , y G M^^x 1 ^ ^ I^max 

where 
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u = (—00, 0, —00, —00) and v = (3, —00, —00, —00), so in this case we have m = 4 and n = 3 with 
the notation of Problem (f27|l . 

Before performing Newton iterations, we need to check whether the system Cy < Dy has solutions 
with 7/2 = —00 but y4 ^ —00 (since supp(u) = {2}). By the second inequality of this system, it 
follows that this is impossible. Hence, Condition (j33p is satisfied and so we can use (|34p in order 
to compute Afc. Moreover, in this example Newton method requires no more than two iterations, 
since player Max has only two strategies, which correspond to the two finite entries in the last row 
ofD. 

Assume that we start with Aq = 0. Then, an optimal strategy a for player Max at Xq is given by: 
cj(l) = 4, a{2) = 2, a{3) = 1, o-(4) = 4 and a{5) = 1. Since I = a{m + 1) = fj(5) = 1, we have 

Ai = min{A G Mmax | Cy < D'^y , y2 = uy < X + vi + yi , yi = is solvable} , 
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and so, setting yi = 0, \i + vi = Xi + 3 is given by: 



mimmize yo 

(39) 

^ ^ s?i6ierf to; (?/2 -4) V(-3) <y4 , (y4 + l) V(-l) < , y4 < , ys VI < y4 + 3 . 

Note that the system of constraints in (j39p . obtained by setting yi = in Cy < D^y (i.e., in (j36 
the first column plays the role of free term), reduces to 

£(MvF.3V.<(M ,..<0, 



where 



Since 



E*h 



-4 ) ( -2 ) ( -2 



the least solution of the system of constraints in ()39p is {y2,y3,y4)'^ = (~l)~oo,— 2). Therefore, 
the value of problem ()39p is —1, and thus Ai = —4. It can be checked that this is the optimal solution 
of the tropical programming problem (and in particular, that a is still a left optimal strategy for 
player Max at Xi = — 4j. 

3.6. Computing left optimal strategies. In order to compute left optimal strategies, consider 
the mean payoff game associated with the tropical linear- fractional programming problem (|27p , and 
let the weights X + v of the arcs connecting node m + 1 of Max with nodes of Min be replaced by 
X — € + V, where e G M. In this way, we obtain a perturbed mean payoff game. For small enough 
e > 0, the optimal strategies for this game are the left optimal strategies required by the positive 
Newton iterations. Here, we will require the mean payoff oracle to find optimal strategies, not just 
the value of the game. The complexity of such oracle will be denoted by MPGI*(m, n, M), for 
mean payoff games with integer payments whose absolute values are bounded by M, with m nodes 
of Max and n nodes of Min. A pseudo-polynomial algorithm for computing optimal strategies of 
such games is described in |ZP96j . 

Proposition 18. // the finite coefficients in ()27p are integers with absolute values bounded by M, 
then at each iteration of the positive Newton method, started and finished as in Remark O a left 
optimal strategy can be found in 

MPGI*(m-F l,n+l, (min(m,n) + 2)(M + 2M(min(m,n) + 1)) + 1) 

operations. 

Proof. By Corollary [9l it follows that each Xk is integer and the breaking points of (p{X) are rational 
numbers whose denominators do not exceed min(m, n) -|- 1. Therefore, optimal strategies for the 
game at A* = — l/(min(m, n) -|- 2) are left optimal strategies at A^. Then, we only need to 
apply a mean payoff oracle in order to compute optimal strategies for the perturbed mean payoff 
game with e = l/(min(m, n) -|- 2). Multiplying (in the usual sense) the payments by min(m, n) + 2 
we obtain a mean payoff game with integer payments and with the same optimal strategies (in 
this sense, equivalent to the perturbed game). The computation of optimal strategies in the latter 
game takes no more than MPGI*(m -|- l,n -|- 1, (min(m,n) -|- 2)(M -|- 2M(min(m, n) -|- 1)) -|- 1) 
operations, because the payments in the perturbed mean payoff game are either of the form a or 
a -|- Afe — e, where \a\ < M and |Afc| < 2M(min(?7i, n) -|- 1), and these payments are multiplied by 
min(m, n) + 2. □ 
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Example 4. In order to find a left optimal strategy a for player Max at \k-i = in Example\^ we 
only need to compute an optimal strategy for the associated game at A* = Afc_i — l/(min(m, n) + 2) = 
— 1/5. This can he done by solving the game whose payments are given by the matrices 
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which are obtained by multiplying (in the usual sense) the payments for the game at A* by 5. 

Remark 11. Proposition [721 was necessary to establish the pseudo-polynomiality of the positive 
Newton method, which regularly uses left optimal strategies. However, as observed in Remark 
the use of left optimal strategies is not necessary when cj){\k) > 0. Moreover, when cj){\k) = and 
the coefficients are integers, an alternative to computing a left optimal strategy is to use an optimal 
strategy, checking whether 4>{Xk — 1) < when Xk+i = Afc. In that case. Corollary IE part (jn]) 
guarantees that A^ is optimal. Otherwise, proceed with Xk+i := A^ — 1. With this modification, the 
complexity of the computation of optimal strategies falls to 

MPGI*(?Ti + l,n + l,M + 2M(min(m, n) + 1)) , 

instead of the bound of Proposition \18[ 

We are now ready to sum up the computational complexity of the positive Newton method with 
left optimal strategies. 

Theorem 19. If the finite coefficients in (j27p are integers with absolute values bounded by M , then 
the positive Newton method, started and finished as in Remark 0, takes no more than 

0(Mmin(m,n)) x {0{mn) + 0{n^) + 

+ MPGI*(m + 1, n + 1, (min(m, n) + 2)(M + 2M(min(m, n) + 1)) + 1)) 

operations. In particular, the positive Newton method is pseudo-polynomial. 

Proof. As the numbers Afc generated by the positive Newton method are integers and lie within 
[—2M (min(m, n)+l), 2M(min(m, n)+l)], the number of iterations does not exceed 4M(min(m, n)+ 
1) + 1. Combining this with Propositions 1171 and 1181 we get the claim. □ 

Note that Remark [TT] can be used to reduce the bound of Theorem llQl if the left optimal strategies 
are not used, getting rid of the factor (min(m,n) + 2) in the third argument of MPGI*. 

3.7. Perturbed mean payoff games as mean payoff games over germs. Next we discuss 
an alternative to the perturbation technique of the previous subsection: instead of considering the 
mean payoff game for several values of the perturbation parameter, we may consider a mean payoff 
game the payments of which belong to a lattice ordered group of germs. In a nutshell, the elements 
of this group encode infinitesimal perturbations of the payments. This algebraic structure allows 
one to deal more generally with one-parameter perturbed games (not only the ones arising from 
tropical linear- fractional programming). A similar structure appeared in [GG98j . This is somehow 
analogous to the perturbation methods used to avoid degeneracy in linear programming. We hope 
to develop this further in a subsequent work. The materials of this subsection are not used in the 
rest of the paper. However, this alternative can be useful in two respects: 1) to develop the present 
Newton method in the case of real coefficients, 2) to improve the complexity result of the previous 
subsection. 
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Consider a mean payoff game over germs, finite-duration version, where the weights of arcs in Q 
are pairs of real numbers (a, b) endowed with lexicographic order: 



and the componentwise addition is used to calculate the weights of paths (or cycles). These 
games correspond to two-sided tropical linear systems over the semiring of germs Gmax := U 
{(-oo, -cx))}, where for = {a^,b^),g'^ = (a^,6^) G Gmax we define ''g^ + 5^" := max(g^,g'^) 
following did]) and '"g^g"^" := (a^ +a'^,b^ + b'^). 

With a game over germs we associate an e-perturbed mean payoff game, for e > 0, in which the 
weights (a, b) of the arcs are replaced by a + eb. If the payments in a mean payoff' game over germs 
are given by the matrices A and B (with entries in Gmax); then the matrices associated with the 
corresponding e-perturbed mean payoff game will be denoted by ^(e) and B{e), respectively. 

Proposition 20. Suppose that the matrices of payments in a mean payoff game over germs (finite- 
duration version) satisfy Assumptions 1 and 2. Then this game has a value and positional optimal 
strategies (meaning that ^ holds for mean payoff games over germs). Moreover, if (xij^i) is the 
value of such a game, then there exists e > such that for any < e < e the associated e-perturbed 
mean payoff game has value Xi + c^i O'nd these games have common positional optimal strategies. 

Proof. Note that if the matrices of payments A and i? in a mean payoff game over germs satisfy 
Assumptions 1 and 2, then for any e-perturbed mean payoff game the corresponding matrices ^(e) 
and -B(e) also satisfy these assumptions. 

Let 5 be the minimal absolute value of nonzero differences between cycle means in the mean 
payoff game with payments given by A{0) and B{0), and let M be the greatest absolute value of 
the second component of germs. Define e := 6/ AM and consider any e such that < e < e. 

By dS]), for the e-perturbed mean payoff game there exist positional strategies cr* and r* such 
that 



for all (not necessarily positional) strategies a and r. Let a be any strategy for player Max 
and assume that ^A(e),B{e){jiT*,a) = a + eb and ^A{e),B{e){j,T'* ,a*) = Xj + e^^j- If a = Xj, 
we have b < kj because a + e6 < Xj + ^i^j- Otherwise (i.e., if a 7^ Xj)^ since \Kj\ < 2M, 
\a — Xj\ > ^5 e < e = S/AM, and a + eb < Xj + it follows that a < Xj- Therefore, we 
conclude that ^A,B{j,T* ,a) = {a,b) <Iq-^ iXji^^j) = *^A,B(j, t"*, o"*)- The same argument shows 
that <I*a,b(J5 T"*! c"*) ^lex ^A,B{j-,'T,a*) for any strategy r for player Min. This proves that the 
finite duration version of the mean payoff game over germs has a value, given by {xj, kj), and that 
positional optimal strategies for the e-perturbed mean payoff game (with e < e) are also optimal 
for the game over germs. 

Assume now that a* and r* are positional optimal strategies for the finite duration version of the 
mean payoff game over germs, and let {Xjii^j) be its value. Then, ^A,B{j-,'T*-,cy) ^lex (^i'^i) —lex 
^A,B{j-,'T,a*) for all strategies a and r (not necessarily positional). 

Let a be any strategy for player Max and assume that ^A,B{j-,'T*-,cy) = {o,,b). If a = Xj^ we 
conclude b < kj because ^A,B{j, t*,(^) <iex (^i' '^i)' thus ^A{e),B{€)ij^ t* ,a) = a + eb < Xj + ^i^j 
for any e > 0. Suppose now that a < Xj- Since \Kj\ < 2M and Xj ~ ^ it follows that 
$^(g)^s(e)(j, r*, o") = a + eb < Xj + ^i^j for any e such that < e < e. The same argument shows 
that ^A{e),B{e){jj Tjf^*) ^ Xj + ^i^j for any strategy r for player Min and any e such that < e < e. 
Therefore, we conclude that a* and r* are positional optimal strategies for the e-perturbed mean 
payoff game and that its value is Xj + ^'^j- This proves the claim. □ 



(40) 




^A(e),iJ(e)(j,T*,Cr) < ^>A(e),iJ(e)(i,T"*,0-*) < ^ A{e),B{e){j , T, CT*) 
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Remark 12. Proposition\20\ opens the way to using mean payoff games over germs in order to find 
right or left optimal strategies in the Newton methods. In that case, note that the second component 
of all finite weights must be set to except for the arcs connecting node m + 1 of Max with nodes of 
Min, where it is set to 1 (for right optimality) or to —1 (for left optimality). This raises the issue 
of developing a direct combinatorial algorithm to solve mean payoff games over germs. Such an 
algorithm would avoid the perturbation technique of the previous subsection. This will be discussed 
elsewhere. 

Example 5. By Proposition \20[ in Example\^we could find a left optimal strategy a for player Max 
at Afc-i = computing an optimal strategy for the mean payoff game over germs whose matrices of 
payments are: 

/ (-3,0) (-4,0) 
(-1,0) -OOG 

-OOG -OOG 

(1,0) -OOG 
\ -OOG (0,0) 

where — oog := (— oo, — oo). 

Remark 13. Proposition [121 extends ([6]) to germs. Note that this equation provides a very crude 
algorithm for computing values and optimal strategies. Further idea is to allow more general algo- 
rithms, showing that they can be applied to mean payoff games over germs. This will be investigated 
elsewhere. 

4. Examples 

4.1. Minimization. We next apply the positive Newton method to the minimization problem 
of Example [2j Recall that the equivalent homogeneous version of this problem is to minimize A 
subject to uy < X + vy, Cy < Dy, and y^ ^ — oo, with C = [A,c\, D = [B,d], u = (2, — 4, — oo) 
and V = (— oo, — oo, 0), where the matrices A, B and the vectors c, d are given in Example [2] (also 
recall that in this example, m = 7 and n = 2). Note that in this case, for any strategy a for player 
Max, the only possible value for I := a{m + 1) = (t(8) is n + 1 = 3. Then, at each iteration k of 
the positive Newton method applied to this problem, in order to compute X^ + vi = we need to 
minimize (2 + yi) V (—4 + 1/2) subject to the system obtained by setting ^3 = in Cy < D'^y, as 
explained in Subsection 13.51 The latter is Problem (I35p for this particular case. 
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Figure 6. The maximization problem of Example [U the tropical polyhedron and 
the spectral function. 

We start the positive Newton method with Aq = 15, where (^(Aq) = 5.5. The function cr(l) = 1, 
(t(2) = 1, . . . , (t(7) = 1 and a{8) = 3 is an optimal strategy for player Max at Aq. To perform the 
first Newton iteration, we find the minimal solution of the system 

0<xi-2, 0<2;i, 0<l + xi, X2- 4:<xi , 

(x2 — 3) V < xi + 2 , X2 — 3 < xi , X2 — 2 < xi , 

which is (X]^, X2) = (2, —00). The next value is Ai = (2 + x^) V (—4 + X2) = 4. Then, </>(Ai) = 1.5 
and a{l) = 2, a{2) = 2, o-(3) = 1, o-(4) = 1, a{5) = 1, cr(6) = 3, cr(7) = 3 and a{8) = 3 is a new 
optimal strategy for player Max. For the next Newton iteration, we find the minimal solution of 
the system 

0<X2,0<X2 — l,0<l+Xi, X2— 4<Xi, 

(x2 - 3) V < xi + 2 , X2 - 5 < , X2 - 6 < , 

which is (x]^,X2) = (—1,1). Then, the next value is A2 = (2 + x^) V (— 4 + X2) = 1. Now 4>{^2) = 0.5 
and cr(l) = 2, a{2) = 2, a{3) = 2, a(4) = 1, cj(5) = 3, a{6) = 3, a{7) = 3 and o-(8) = 3 is the 
optimal strategy for player Max. For the next Newton iteration, we find the minimal solution of 
the system 

< X2 , < X2 - 1 , < X2 - 2 , (x2 - 3) V < XI + 2 , 
X2-4:<0 , X2-5<0, X2-6<0, 

which is (x^, X2) = (—2, 2). This gives A3 = (2 + x^) V (—4 + X2) = 0, which is the optimal value 
A*. The optimality of A* = can be certified applying Theorem 1121 see Example [2] above. 

The vectors (2,— 00), (—1,1) and (—2,2) found by the Newton iterations are indicated on the 
left-hand side of Figure as "1", "2" and "3". 

The right-hand side of Figure [5] displays the graph of <j){X), together with the Newton iterations. 
The graphs of partial spectral functions (j)^{X) are given by red dashed lines. 

4.2. Maximization. Consider the maximization problem of Example [TJ We next apply the posi- 
tive Newton method to the homogeneous version (j29p of the equivalent minimization problem. 

With this aim, firstly observe that in this case n-|- 1 = 3 G supp(ii) = {3}, and so Condition (j33p 
is always satisfied. Therefore, as explained in Subsection 13.51 &t each iteration of the positive 
Newton method applied to this problem, A^ -|- vi can be computed by minimizing subject to the 
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Figure 7. Number of iterations of Newton method (thin blue hue) and bisection 
method (thin red hne) in the cases of minimization (left) and maximization (right). 
Thick blue line: average number of iterations of Newton method for each interval of 
20 dimensions. Thick red line: level log(2M) ~ 10. 

system obtained by setting = in Cy < D'^y, which corresponds to Problem ()35p in the case of 
this example. 

Let us take Aq = 3. Then, we obtain that ct(1) = 3, a{2) = 3, cj(3) = 3, (t(4) = 3 and a{5) = 2 
is an optimal strategy for player Max at Aq. To perform the Newton iteration we first notice that 
I = a{m + 1) = (t(5) = 2, which means that Ai + u 2 = Ai + 3 is the minimum of 2/3 subject to the 
system obtained by setting 7/2 = in Cy < D"y, as explained above. Thus, we have to find the 
minimal solution of the following system: 

a^s > -1 , a^s > (-2 + xi) V (-2) , X3 > -1 + xi , x^>xi, 

which is (x^, X3) = (—00, —1). The full vector y = (—00, 0, —1) is a translate of y + 1 = (xi, X2, 0), 
where (xi,X2) = (— oo,l) is marked as "1" at the left of Figure [6l Meanwhile we obtain Ai = 
X3 — 3 = —4, and <t(1) = 1, (t(2) = 3, <t(3) = 2, cr(4) = 2 and (j(5) = 2 is now a new optimal 
strategy for player Max. Again, here / = a[m + 1) = (t(5) = 2 and so the second columns of C and 
D"" are the free terms in (j35p . We have to find the minimal solution of the following system: 

xi > -1 , X3 > (-2 + xi) V (-2) , > -1 + xi , 2 > xi , 

which is (x;^,X3) = (—1, —2). We obtain A2 = Xg — 3 = —5, which is the optimal value, and so the 
value of the original maximization problem is 5. The full vector y = (—1,0, —2) is a translate of 
y + 2 = (xi, X2, 0), where (xi, X2) = (1,2) is marked as "2" at the left of Figure El 

As in the case of Figure [U the right-hand side of Figure [6] displays the graph of (/)(A), together 
with the Newton iterations. The graphs of partial spectral functions (t^"{X) are given by red dashed 
lines. 

4.3. Numerical experiments. A preliminary implementation of the bisection and Newton meth- 
ods for tropical linear-fractional programming was developed in MATLAB. We next present some 
graphs showing how they behave on randomly generated instances of tropical linear-fractional pro- 
gramming problems, in which the entries of matrices and vectors range from —500 to 500. The 
matrices A and B in (|28p and (|26p are square, with dimensions ranging from 1 to 400. 

Figure [7] displays the cases of the tropical linear programming (I28p , in which all the entries are 
finite. Here the certificates of unboundedness reduce to the solvability of a two-sided tropical system 
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Figure 8. Number of iterations of Newton method (thin blue hne) and bisection 
method (thin red hne) in the case of minimization with M = 500000. Thick blue line: 
average number of iterations of Newton method for each interval of 20 dimensions. 
Thick red hne: level log(2M) -1^19. 

of inequalities. When a feasible and bounded problem is generated, it is solved by the bisection 
and Newton methods. 

For the bisection method, we use the lower initial values Ag of jBAOSj . see also Remark [TOl 
Following jBAOSj . the upper initial values Aq for the bisection method come from a solution of 
Ax V c < Bx V d. To find this solution, we use the policy iteration of jPGOGj instead of the 
alternating method of jCGB03j . Shown by the thin red line (up to m = n = 250), the bisection 
method worked similarly in the case of minimization and maximization. In our experiments, the 
interval between lower and upper initial values never exceeded 2M = 1000, with the number of 
iterations quickly approaching a constant level of 9 or 10 iterations (logM ~ 9 or log2M ~ 10). 

The thin blue line represents the run of Newton method, and the thick blue line represents their 
average number calculated for each interval of 20 dimensions. For the sake of fair comparison with 
the bisection method, the initial value Aq coincides with the upper initial value Aq for the bisection 
method. This value comes from a solution of Ax V c < Bx V d, instead of the theoretical value 
2M(n + 1), which depends on n and may be much greater. In the case of minimization, the average 
number of Newton iterations slowly grows, being smaller than 10 before n ~ 250, but exceeding 
10 at larger dimensions. Naturally, the number of iterations for the same dimension may be very 
different, depending on the configuration and complexity of the tropical polytopes (i.e., the solution 
sets of Ax V c < Bx V d). In the case of maximization, the number of iterations is usually below 
5. Note that maximization is resolved immediately if we find the greatest point of the solution set, 
which suggests that the maximization problem may be simpler. We also remark that there is no 
correlation between the number of iterations of the bisection and Newton methods. In particular, 
it is easy to construct instances with large integers in which the number of bisection iterations 
becomes arbitrarily large, whereas the number of Newton iterations remains bounded. This agrees 
with Figure [HI where in comparison to the graph on the left-hand side of Figure [71 M is equal to 
500000 instead of 500. 

Figure [9] displays the cases of tropical linear- fractional programming (j26p with all entries finite 
(right) and with a 0.7 frequency of — oo entries (left). In the case of —oo entries, as required by 
Assumptions 1 and 2, we ensure that the set of constraints contains neither — oo rows on the right- 
hand side nor —oo columns on the left-hand side. The case of tropical linear-fractional programming 

30 




Figure 9. Number of iterations of Newton method (thin blue hne) and bisection 
method (thin red Une) in the cases of hnear-fractional programming with finite 
entries (right) and when the average proportion of — oo entries is 0.7 (left). Thick 
blue line: average number of iterations of Newton method for each interval of 20 
dimensions. Red line on the left: level log(2M) ~ 10. 



with finite entries shows almost the same picture as in the case of minimization above. The case 
when — oo appears with a regular frequency is even more favorable for Newton method, due to the 
sparsity of Q. 

5. Conclusion 

In this paper, we developed an algorithm to solve tropical linear-fractional programming prob- 
lems. This is motivated by the works [AGGOSj and [A1109j . in which disjunctive invariants of 
programs are computed by tropical methods: tropical linear-fractional programming problems are 
needed to tropicalize the method of templates introduced by Sankaranarayanan, Colon, Sipma and 
Manna |SSM051 ISCSMOH] . 

The main technical ingredient, which combines ideas appearing in |AGG09[ lAGKllbl IGSlOj is 
to introduce a parametric zero-sum two-player game (in which the payments depend on a scalar 
variable) , in such a way that the value of the initial tropical linear- fractional programming problem 
coincides with the smallest value of the variable for which the game is winning for one of the players. 
The value of the parametric game, which we call the spectral function, is a piecewise affine function 
of the variable. Then, the problem is reduced to finding the smallest zero of the spectral function, 
which we do by a Newton-type algorithm, in which at each iteration, we solve a one-player auxiliary 
game. 

Using this game-theoretic connection, we present concise certificates expressed in terms of the 
strategies of both players, allowing one to check whether a given feasible solution is optimal, 
or whether the tropical linear-fractional programming problem is unbounded. This is inspired 
by [AGKllb] . in which certificates of the same nature were given for the simpler problem of 
certifying whether a tropical linear inequality is a logical consequence of a finite family of such 
inequalities. 

We also develop a generalization of the bisection method of |BA08j . The latter, as well as Newton 
method, are shown to be pseudo-polynomial. Note that at each iteration, both methods call an 
oracle solving a mean payoff game problem (for which the existence of a polynomial time algorithm 
is an open question - only pseudo-polynomial algorithms are known). The pseudo-polynomial 
bound that we give for Newton method is worse than the one concerning the bisection method, 
however, for the former we also give a non pseudo-polynomial bound, involving the number of 
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strategies, which is better than the pseudo-polynomial bound if the integers of the instance are 
very large. This is confirmed by experiments, with a preliminary implementation, which indicates 
that Newton method scales better as the size of the integers grows. In addition, it has the advantage 
of maintaining feasibility, and there are significant special instances in which it converges in very 
few iterations. 

The Newton method of this paper appears as a natural product of the game-theoretic connection 
and the spectral function approach. We further concentrate on the implementation of each Newton 
step by reduction to optimal path algorithms, and on the proof of pseudo-polynomiality. This 
method could be also considered in the framework of more abstract Newton methods in a generalized 
domain, which also means making decent comparison with other Newton schemes, like |EGKS08] . 
The comparison of Newton and bisection methods, as well as possible alternative approaches, also 
remain to be further examined. 
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